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AN  EXTENSION  TO  THE  WE  I  BULL  PROCESS  MODEL 


1.  INTRODUCTION 

Recent  papers  by  Bain  and  Engelhardt  ( 1980) 1  and  Crow  (1977)2 
have  investigated  inferential  procedures  for  the  time  truncated,.  Wei  bul 1 
process,  a  nonhomogeneous  Poisson  process  with  intensity  R(t/T)y_1.  An 
intensity  function  of  this  form  is  often  used  to  model  the  failure  rate  of 
a  repairable  system  that  is  being  tested  for  reliability  growth  (see 
Figure  1,  test  phase  A).  In  such  applications,  a  test  phase  in  which  the 
failure  rate  is  changing  is  sometimes  followed  by  a  test  phase  in  which 
system  conf iguration  is  fixed  and  the  failure  rate  is  therefore  constant 
(Figure  1,  test  phase  8).  This  latter  test  phase  is  modeled  as  a  homogene¬ 
ous  Poisson  process  with  intensity  R  and  is  usually  intended  to  demonstrate 
the  reliability  of  the  final  system  configuration  with  adequate  confidence. 
In  this  paper,  we  show  how  to  conduct  a  unified  analysis  of  the  failure 
data  from  the  two  consecutive  test  phases  so  that  the  data  from  the  Weibull 
process  can  be  combined  with  the  data  from  the  homogeneous  Poisson  process 
to  evaluate  the  final  system  failure  rate  R. 

Our  primary  objective  in  studying  this  compound  nodel  is  to 
reduce  the  length  of  test  phase  B  while  controlling  the  overall  risks  to 
consumer  and  producer.  Optimal  procedures  for  accompl ishing  this  objective 
are  introduced  in  Section  3  and  illustrated  in  Sections  4  and  5.  Also 
provided  are  point  estimators  for  the  model  parameters  (Section  2)  and  a 
test  for  goodness-of-fit  (Section  6). 

2.  POINT  ESTIMATORS 


The  Weibull  process  begins  at  time  0  and  terminates  at  time 
T;  the  homogeneous  Poisson  process  with  intensity  R  then  commences  and 
continues  until  time  T  +  S.  The  intensity  function  of  the  resulting 
nonhomogeneous  Poisson  process  is  shown  in  Figure  1  and  may  be  written 


R(t/T)  0-1 

r(t)  = 

R 


if  0  _<  t  <  T, 
if  T  <  t  <  T  +  S, 


(1) 


where  R  >  0  and  g  >  0.  Let  K  be  the  total  number  of  failures  up  to  time 
T  +  S,  N  the  number  pf  failures  that  occur  before  time  T,  and  Tj,  ..., 

Tn  the  failure  times  for  the  time  truncated  Weibull  process  (0  <  Ti  < 

...  <  Tfy  <  T).  Then  the  Poisson  process  with  intensity  function  r(t) 
has  a  sample  function  density  given  by 


f<,N,T! 


,tn  (k*n»t1."*.tn) 


1  Bain,  L.  J.  and  M.  Engelhardt,  "Inferences  on  the  Parameters  and  Current 
System  Reliability  for  a  Time  Truncated  Weibull  Process,"  Technometrics, 
Vol.  22,  pp.  421-426,  August  1980. 

2  Crow,  L.  H.,  Confidence  Interval  Procedures  for  Reliability  Growth  Analy¬ 
sis,  Technical  Report  No.  197,  US  Army  Materiel  Systems  Analysis  Activity, 
Aberdeen  Provinj  Ground,  MO,  June  1977. 
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Figure  1.  Intensity  Function  for  the  Cose  0</3<\. 


1 


exp(-RT/0  -RS)  (RS)  /  k\  if  N=0,  (2.1) 

* 

kRk 

where  n=l,?,...  and  0  <  tj  <  ...  <  tn  <  T}  k =  0 ,  < >  ^ )  • . .  • 

This  two-parameter  model  is  used  in  applications  where  P(N=0)  is 
quite  small,  and  therefore  the  likelihood  expression  in  equation  (2.2)  can 
he  maximized  to  obtain  the  following  estimators  for  3  and  R: 

0  -  [-T  +  (T2  +  4  KST/Y)l/*]/2S.  (3) 

R  =  K/(S  +  T/2),  (4) 

N 

where  Y  ~  \  ln(T/T^).  These  point  estimators  may  be  compared  with  those 
i  =  l 

for  a  time  truncated  Weibull  process  alone  in  Bain  and  Engelhardt  (1980, 
Equations  (4)  and  (5)). 

3.  INFERENCES  ON  FINAL  FAILURE  RATE  R 

In  order  to  deal  with  this  two  parameter  model,  we  henceforth 
condition  on  the  event  N  >  0  and  obtain  from  Equation  (2.2)  the  conditional 
density 


n  l-B 

n  (T/tJ  5  exp(-RT/B  -  RS)  if  N=n>0,  (2.2) 

1  =  1 


fC  (k  »n , . . .  ,tn ) 


=  Rk 


n  (T/t^ 
i  =  l 


1-6 


exp(-RT/e  -RS)/(l-exp(-RT/s))  S"~ 


(5) 


where  n=l,?,...  and  0  <  tj  <  . . .  <  t„  <  T.  As  in  Bain  and  Engelhardt  (1980, 
equation  (7)),  it  is  apparent  that  Y  is  sufficient  for  3  and  that  the  con¬ 
ditional  distribution  of  K  given  Y  =  y  can  be  used  to  construct  uniformly 
most  powerful  unbiased  (UMPU)  tests  for  R  (Reference  3,  pp.  134-140). 


To  obtain  this  distribution,  consider  first  the  conditional 
distribution  of  N  given  Y  =  y  which  appears  in  Bain  and  Engelhardt  (1980, 
equation  (8)): 

P(N=n | Y»y)  =  G(RTy)  (RTy)n/n ! (n-1) ! ,  (6) 


where  n=l,?,...  anrt  G(x) 


x'Vj !  (j- 


D! 


-1 


3  Lehmann,  E.  L.,  Testing  Statistical  Hypotheses,  .John  Wiley  and  Sons,  New 
York,  NY,  1959. 
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Test  phases  A  and  B  constitute  two  independent  experiments,  and  therefore 
P(K  *  k,  N  =  n  |  Y  =  y) 

=  P(N  =  n|  Y  =  y)  (RS)*-"  exp(-RS)/(k-n) ! ,  (7) 

where  k  =  1,?,...  and  n=l,...,k.  Summing  over  n,  we  obtain  the  desired 
probability  distribution 

P(K  =  k  j  Y  =  y) 

k 

=  G(RTy)  (RS)k  exp(-RS)  \  (Ty/S)"/n ! (n-1 ) ! (k-n) !  (8) 

n=l 

and  the  cumulative  distribution  function 
k 

F(k;  R  |  y)  s  £  P(K  *  j  |  Y  =  y),  (9) 

i=l 


where  k  =  1,?,...  .  It  is  noted  that  the  conditional  probability  distri¬ 
butions  specified  in  Equations  (6)  and  (8)  can  be  readily  computed  at 
minimal  cost. 

The  distribution  function  F  can  be  used  to  construct  a  variety  of 
inferential  procedures  for  the  parameter  R.  For  example,  confidence  bounds 
on  R  can  be  constructed  by  techniques  similar  to  the  procedures  in  Reference 
4.  In  this  paper,  we  concentrate  on  properties  of  the  conditional  operating 
characteristic  curves  and  show  how  they  may  be  used  to  appraise  the  need  for 
test  phase  B. 

Let  k0  be'the  maximum  total  number  of  failures  acceptable  durinq 
the  two  test  phases,  and  suppose  we  observe  Y  =  y  durinq  test  phase  A. 

Then  the  conditional  operating  characteristic  curve  for  this  test  may  be 
depicted  as  the  probability  of  acceptance,  F(kg;R|y),  as  a  function  of  R. 

The  conditioning  variable  Y  has  an  important  effect  on  the  properties  of 
this  test.  Since  y  and  T  occur  everywhere  in  equations  (6)  and  (8)  as  a 
product,  it  is  clear  that  the  test  time  for  test  phase  A  will  appear  lonqer 
or  shorter,  in  some  sense,  accordingly  as  Y  is  larger  or  smaller.  A  signif¬ 
icant  consequence  of  this  phenomenon  is  that  producer  and  consumer  risks 
will  qenerally  be  smaller  if  a  relatively  larger  value  of  Y  is  observed. 

In  the  following  two  sections  we  consider  a  testinq  situation 
in  which  test  phase  A  is  first  completed  and  afterwards  the  length  of  test 
phase  R  Is  to  be  determined.  The  observed  value  of  Y  can  then  be  used  to 
decide  how  much,  if  any,  additional  test  time  S  is  desirable  in  order  to 
control  the  statistical  risks  of  the  overall  test.  A  suitable  procedure 


A  Miller,  G. ,  Confidence  Intervals  for  the  Reliability  of  a  Future  System 
Configuration,  Technical  Report  No.  343,  US  Army  Materiel  Systems  Analysis 
Activity,  Aberdeen  Proving  Ground,  Mf),  September  1981. 
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for  conduction  this  decision-makinq  process  is  illustrated  by  a  detailed 
example  in  Section  4.  To  simplify  the  presentation,  we  consider  a  case  in 
which  the  proposed  test  phase  B  is  of  a  qiven  lenqth  S  and  the  only  decision 
to  he  made  is  whether  to  conduct  test  phase  B  or  not.  The  more  complicated 
case  in  which  test  phase  B  is  of  variable  lenqth  can  be  handled  in  a  similar 
manner  by  examininq  an  appropriate  selection  of  constant  lenqth  test  phases. 

4.  DECISION  PROCEDURE 

A  system  is  scheduled  to  undergo  a  reliability  growth  test  phase 
of  T  =  2000  hours  and  could  be  slated,  if  necessary,  for  a  follow-on 
fixed  conf i quration  test  phase  of  S  =  750  hours.  The  minimum  acceptable 
value  (:iAV)  for  reliability  is  a  mean  time  between  failures  (MTRF)  of  51 
hours,  which  corresponds  to  a  failure  rate  of  51~1  per  hour.  The  consumer’s 
risk  is  the  probability  of  accepting  the  system  when  it  barely  attains  the 
MAY.  The  producer  is  required  by  contract  to  achieve  92  hours  MTBF;  so 
the  producer's  risk  is  the  probability  that  the  system  will  he  rejected 
even  though  this  contractual  requirement  is  met. 

Our  objective  in  this  example  is  to  eliminate  the  75D  hour  test 
phase  B  whenever  doing  so  will  not  result  in  excessive  risks  to  either 
consumer  or  producer.  These  risks  have  been  computed  through  the  use  of 
equation  (6)  for  a  single  reliability  qrowth  test  phase  of  length  T  = 

?ono,  and  the  results  are  shown  in  Table  1  over  a  reoresentati ve  range 
of  values  for  the  conditional  variable  Y.  (As  a  guide  in  choosing  a  range 
of  likely  outcomes  for  Y,  note  that  the  conditional  distribution  of  2bY 
given  N  =  n  is  a  chi-square  with  2h  degrees  of  freedom).  The  acceptable 
numbers  of  failures  in  this  illustration  were  selected  so  as  to  balance 
the  risks,  though  other  choices  could  have  been  made. 

TABLE  1  -  PERCENTAGE  RISKS  FOR  TEST  PHASE  A  ALONE. 


V 

Acceptable  Number 
of  Failures 

Consumer's 

Risk 

Producer's 

Risk 

Sum  of 
Risks 

10.0 

17 

21.0 

17.6 

38.6 

20.0 

24 

15.7 

14.6 

30.3 

30.0 

29 

10.9 

14.9 

25.8 

40.0 

34 

11.2 

10.9 

22.1 

50.0 

38 

9.7 

9.9 

19.6 

60. 0 

4? 

10.0 

7.7 

17.7 

70.0 

45 

7.8 

8.1 

15.9 

ho.  n 

48 

6.3 

7.8 

14.6 

It  is  apparent  in  Table  1  that  the  risks  tend  to  decrease  as  y 
increases.  This  tendency  is  a  manifestation  of  the  oheno-nenon  previously 
mentioned,  that  the  test  will  appear  longer  for  larqer  values  of  y.  Our 
technique  in  this  example  is  to  select  a  critical  value  y0  such  that  if 
Y  >  v0,  then  test  phase  A  alone  will  he  sufficient  to  evaluate  the  system 
reliabi lity. 

Before  selectinq  yg,  we  may  wish  to  compare  the  risks  involved 
when  both  test  phases  A  and  R  are  conducted.  These  risks  are  computed 
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throuqh  the  use  of  equations  (8)  and  (9)  for  T  =  2000  and  S  =  750,  and  the 
results  are  shown  in  Table  2.  As  expected,  the  additional  testinq  yields 
lower  risks,  and  a  decreasinq  trend  in  risks  is  apparent  as  y  increases. 

TARLE  2  -  PERCENTAGE  RISKS  FOR  THE  COMBINATION  OF  TEST  PHASES  A  AND  B. 


y 

Acceptable  Number 
of  Failures 

Consumer's 

Risk 

Producer's 

Risk 

Sun  of 
Risks 

10.0 

28 

10.0 

9.1 

19.1 

20.0 

35 

7.8 

7.7 

15.5 

30.0 

41 

8.1 

5.3 

13.4 

40.0 

45 

5.8 

6.0 

11.8 

50.0 

49 

5.1 

5.4 

10.5 

60.0 

53 

5.2 

4.3 

9.5 

70.0 

56 

4.1 

4.5 

8.6 

80.0 

59 

3.6 

4.4 

8.0 

ihe  problem  at  hand  is  to  choose  y0,  the  smallest  value  of  y 
at  which  the  risks  shown  in  Table  l  are  worth  takinq  in  order  to  save  the 
time  and  exoense  of  conductinq  test  phase  B.  This  choice  of  yQ  is  the 
only  difficult  step  in  applying  the  methodoloqy  discussed  herein  and  may 
require  a  decision  by  top  management.  The  proqram  manager  will  usually 
have  budqetary  constraints  to  consider,  and  the  contract  may  require  that 
risks  not  exceed  certain  levels.  For  our  purposes,  we  shall  choose  y0  * 
45.0  and  accordingly  say  that  additional  testing  is  desirable  if  Y  <  45.0, 
hut  that  otherwise  (Y  _>  45.0)  test  phase  B  need  not  be  conducted. 

Once  y0  is  chosen,  our  conditional  procedure  for  scheduling 
test  phase  B  is  well-defined  with  risks  as  stated  in  Table  3.  These 
risks  are  the  same  as  in  Table  2  for  y  less  than  45.0,  since  test  phase 
B  would  then  be  scheduled.  For  y  greater  than  45.0  the  risks  are  taken 
from  Table  1,  since  in  that  instance  test  phase  B  would  not  be  conducted. 
Note  that  all  of  the  analysis  up  to  this  point  has  been  accomplished 
without  knowledge  of  any  test  results,  and  in  particular,  the  choice  of 
y0  does  not  depend  on  the  results  from  test  phase  A. 


TABLE  3  -  PERCENTAGE  RISKS  FOR  PROCEDURE  WITH  y0  =  45.0. 


y 

Acceptable  Number 
of  Failures 

Consumer's 

Risk 

Producer's 

Risk 

Sum  of 
Risks 

10.0 

28 

10.0 

9.1 

19.1 

20.0 

35 

7.8 

7.7 

15.5 

30.0 

41 

8.1 

5.3 

13.4 

40.0 

45 

5.8 

6.0 

11.8 

50.0 

38 

9.7 

9.9 

19.6 

60.0 

42 

10.0 

7.7 

17.7 

70.0 

45 

7.8 

8.1 

15.9 

80.0 

48 

6.8 

7.8 

14.6 
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Table  3  shows  risks  that  are  reasonable  over  a  wide  ranqe  of 
values  for  y.  These  risks  may  be  compared  with  those  from  a  conventional 
analysis  of  a  750  hour,  fixed  configuration,  reliability  demonstration 
test:  20.5  percent  consumer's  risk  and  12.3  percent  producer's  risk  (when 
11  failures  are  acceptable).  By  utilizing  information  from  the  previous 
reliability  qrowth  testing,  our  procedure  reduces  risks  and,  in  many  cases, 
eliminates  the  need  for  a  follow-on  test  phase. 

5.  ANALYSIS  OF  OATA 

The  2000  hour  reliability  growth  test  phase  in  Section  4  was 
eventually  conducted,  and  the  following  35  failure  times  were  recorded: 


13.4 

329.5 

811.4 

1213.6 

1585.1 

49.9 

417.0 

815.2 

1330.3 

1605.9 

72.8 

609.8 

824.2 

1336.4 

1672.9 

86.9 

612.9 

830.7 

1429.5 

1715.9 

177.4 

669.7 

895.2 

1477.2 

1756.2 

191.3 

704.1 

944.6 

1512.6 

1825.3 

243.9 

749.3 

1156.7 

1548.2 

1875.3 

35 

The  observed  value  of  Y  was  therefore  y  =  [  ln(2000/t'j)  =  40.1,  which 

i  =  1 

is  less  than  the  critical  value  y0  =  45.0,  Consequently,  the  follow-on 
fixed  configuration  test  of  750  hours  was  conducted,  and  10  more  failures 
were  observed. 

(Jsinq  the  observed  values  y  *  40.1  and  k  *  45,  we  can  obtain 
from  Equation  (9) 

F(k;  51-1  |  y)  =  .Q57 

and  infer  with  94.3  percent  confidence  that  the  producer  did  achieve  the 
rtAV  of  51  hours  'ITBF.  The  point  estimates  obtained  from  equations  (3) 
and  (4)  are  8  *  .851  and  8-1  *  68.9  hours  MTBF. 

6.  000DNESS-0F-F IT  TEST 

Let  M  denote  the  number  of  failures  that  occur  during  the  fixed 
configuration  test  phase  B.  As  derived  in  Section  8,  the  conditional 
probability  distribution  of  M  given  K  *  k  and  Y  =  y  is 

P(“4  *  m|  K  *  k,  Y  «  y)  ■  H(k,.v)(S/yT)m/m!  (k-m)  !k-m-l) ! ,  (10) 

where  y  >  0;  k  *  1,2,...;  m  ■  0,1,  ...,  k  -  1;  and 


H(k,y)  *  Q  (S/yT)j/j!(k-j)!(k-j-l)!]-l.  This  probability  distribution 

i*o 

Is  shown  in  Table  4  for  the  data  set  considered  in  the  previous  section 
(k=45,  y=4Q.l). 


TABLF  4  -  CONDITIONAL  PROBABILITY  DISTRIBUTION  OF  M. 


m 


m 

Prob  (m) 

l  Prob 

j-o 

n 

0.000 

0.000 

1 

0.000 

0.000 

2 

o.onn 

0.000 

3 

0.001 

0.001 

4 

0.004 

0.005 

5 

0.012 

0.017 

6 

0.028 

0.045 

7 

0.056 

0.101 

8 

0.093 

0.194 

9 

0. 128 

0.322 

10 

0.1S1 

0.473 

11 

0.153 

0.626 

12 

0.133 

0.759 

13 

0.101 

0.860 

14 

0.067 

0.927 

IS 

0.039 

0.966 

16 

0.020 

0.986 

17 

0.009 

0.995 

18 

0.003 

0.998 

Id 

0.001 

0.999 

20 

0.001 

1.000 

For  this  particular  example.  Table  4  indicates  that  the  number 
of  failures  observed  during  test  phase  B  will  be  in  the  range  from  6  to 
lh,  inclusive,  with  probability  0.959.  Therefore  to  obtain  a  goodness- 
of-fit  test  with  a  3.1  percent  significance  level,  we  reject  the  noriel  for 
M  <  6  or  M  >  16.  This  kind  of  test  can  be  used  to  detect  an  unexpected 
change  in  reliability  during  test  phase  8. 

7.  CONCLUSIONS  AND  SUMMARY 

The  efficiency  of  a  reliability  assessment  is  greatly  increased 
by  the  use  of  an  extended  model  which  allows  a  unified  treatment  of  the 
data  from  two  separate  test  phases.  The  amount  of  system  testing  may  be 
reduced,  and  in  some  cases  an  entire  test  phase  may  be  eliminated.  At  the 
same  tine,  both  consumer  and  producer  risks  can  be  held  below  levels  often 
encountered  in  conventional  reliability  demonstration  tests. 

A  workable  model  for  realizing  these  beneficial  results  is  pre¬ 
sented  in  Sections  1  and  2,  and  in  Section  3  the  appropriate  conditional 
distribution  is  obtained  for  performing  UMPU  hypothesis  tests  on  the  final 
system  reliability.  The  method  is  illustrated  by  a  realistic  example  in 
Sections  4  and  5,  and  a  test  for  qooriness-of- fi t  is  introduced  and  applied 
in  Section  6. 
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8.  APPENDIX 


Conditional  on  N  =  n  >  0,  the  random  variables  ln(T/Ti),  i  = 
l,  ....  n,  are  distributed  as  the  (reversed)  order  statistics  from  n  inde¬ 
pendent  exponential  distributions  with  mean  0-1,  and  therefore  the 
n 

statistic  Y  =  £  ln(T/T-j )  is  distributed  as  a  qamma  variable  with  probability 
i  =  l 

density  function 

t'v|N  (V|n)  s  6°  yn_1  exp(-0y)/(n-l)!  (11) 

for  y  >  0.  From  equation  (11)  it  is  straightforward  to  obtain  the  joint 
probability  density  function  of  Y,  K,  and  M  as 

Rk  exp(-0y-RT/0-RS)  yk-rn-1  Tk->n  Sm/m!  (k-m) !  (k-m-1) ! ,  (12) 

where  y  >  0,  k  =  1,2,...,  and  m  =  0,1,...,  k  -  1.  Equation  (10)  can  now 
be  derived  from  Expression  (12).  Notice  in  (12)  that  K  and  Y  are  sufficient 
statistics  for  R  and  0,  so  that  these  parameters  do  not  appear  in  the 
conditional  probability  distribution  (10). 
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